Individually interactive multi-view display system for non-stationary viewing locations and methods therefor

ABSTRACT

A multi-view display system that permits viewers to individually interact therewith to communicate commands or viewing preferences is disclosed. Methods in accordance with the present teachings enable a multi-view display to deliver a unique content stream to each of plural viewers, based on the viewers&#39; interactions with the multi-view display system, wherein the viewers are not in fixed locations.

STATEMENT OF RELATED CASES

This case claims priority of U.S. Patent Application Ser. 62/109,570filed Jan. 29, 2015 and is incorporated herein by reference. This caseis also related to the following U.S. patent applications, all of whichwere filed on even date herewith and all of which are incorporated byreference. To the extent there are any inconsistencies between thelanguage used in this disclosure and the language used in Ser.62/109,570 or the cases listed below, the language used in thisdisclosure controls:

“Method for Calibrating a Multi-view Display” (Dkt. No. 3081-001us1);

“Differentiated Content Delivery System and Method Therefor” (Dkt. No.3081-003us1); and

“Individually Interactive Multi-View Display System and MethodsTherefor” (Dkt. No. 3081-005us1).

FIELD OF THE INVENTION

This disclosure pertains to multi-view displays.

BACKGROUND OF THE INVENTION

A multi-view display can present a different image to each one of pluralviewers that are at different viewing locations with respect to thedisplay. For example, Sharp Corporation and Microsoft Corporation havedeveloped displays that are capable of showing a small number ofindependent views based on the viewer's angle with respect to thedisplay. Viewers can interact with these displays using standard controldevices. For example, there might be separate game controllers for aleft view and a right view.

Advances in technology are expected to result in next-generation MVDsthat would enable hundreds to thousands of people to simultaneously viewa single display yet each see something different. These devices willoperate by controlling the images presented at different viewinglocations, each of which locations having a unique viewing angle withrespect to each pixel in the MVD.

The ability to present, on a single viewing screen, different images todifferent viewers based on their viewing location presents interestingpossibilities.

SUMMARY OF THE INVENTION

A multi-view display (MVD) possesses the ability to present, on a singleviewing screen, different images to different viewers based on adifference in each viewers' viewing location. The inventors recognizedthat this unique ability of an MVD could be leveraged to great benefitif each viewer could individually interact with the system. Based onthat recognition, the inventors sought to develop systems and methods bywhich individual interactions can be associated with each viewpoint(i.e., viewing location or viewer) to thereby enable simultaneous, mass,personalized interaction with an MVD.

The present invention provides a way for viewers to individuallyinteract with an MVD system, such as, for example, to communicatecommands or viewing preferences. Methods in accordance with the presentteachings enable an MVD to deliver a unique content stream to each ofplural viewers, wherein the viewers are not in fixed locations.

In the illustrative embodiment, an individually interactive MVD systemin used in the context of advertising, such as to provide an improvedproduct display in a retail store.

In accordance with the illustrative embodiment, an MVD system includesat least one MVD, a system controller, and a sensing system. Each vieweris able to interact with the MVD system by making gestures that arecaptured by the sensing system. The gestures convey information; thatis, viewer commands/preferences pertaining to content of interest to theviewer.

The MVD system, via the sensing system and appropriate software runningon the system controller, is capable of detecting the presence andlocation of each viewer in a detection region, associating the gestureswith one or more gesticulating viewers, and interpreting the gestures.The MVD system is further capable of generating appropriate contentupdates for each viewer based on the interpreted gestures and causingthe display to present the updated content to each viewer at theirrespective locations.

In accordance with the illustrative embodiment, the delivery location ofeach content stream (i.e., the location at which the content can beviewed) “follows” the associated viewer, as appropriate, as they movethrough the detection region. In the illustrative embodiment, content isnot displayed to a viewer while they are moving. Rather, when a viewerinteracts with the MVD system at a first location, the system respondsby delivering updated content to the viewer for viewing at the firstlocation. When the viewer moves, content delivery to the viewer at thatlocation ceases. When the viewer again stops at a second location andagain interacts with the MVD system, the system responds by deliveringupdated content to the viewer for viewing at the second location.

In some further embodiments, after a viewer's first interaction with theMVD system, content is continuously displayed to the viewer as they movethrough the detection region. In yet some additional embodiments, aftera viewer interacts with the MVD system, content is displayed for alimited period of time (e.g., 5 seconds, 10 seconds, etc.) and/or for alimited distance (i.e., 1 meter, 2 meters, etc.) once the viewer movesfrom the location of interaction.

As such, in the context of delivering content to a non-stationaryviewer, “follow” means that content is delivered to the viewer at morethan one location, although not necessarily on a continuous basis.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A depicts a multi-view display system capable of updating thelocation of viewers through a viewing environment, in accordance withthe illustrative embodiment of the present invention.

FIG. 1B depicts viewers viewing different content on the system of FIG.1A.

FIG. 1C depicts the system of FIG. 1A, wherein the viewers have moved tonew locations.

FIG. 1D depicts viewers viewing different content on the system of FIG.1A.

FIG. 2 depicts a block diagram of a method for operating a multi-viewdisplay system.

FIG. 3A depicts the system of FIGS. 1A and 1B in use in conjunction witha product display, wherein viewers are in a first position.

FIG. 3B depicts the arrangement depicted in FIG. 2A wherein one of theviewers has moved to a second position.

FIG. 4 depicts an alternative embodiment of the multi-view displaysystem of FIGS. 1A and 1B, wherein a sensing system of the multi-viewdisplay system includes microphones.

FIG. 5 depicts an alternative embodiment of the multi-view displaysystem of FIGS. 1A and 1B, wherein an installed communications system isused.

FIG. 6 depicts an alternative embodiment of the multi-view displaysystem of FIGS. 1A and 1B, wherein a viewer-provided communicationsdevice with interface application is used.

FIG. 7 depicts a block diagram of a system controller of the multi-viewdisplay system of FIGS. 1A and 1B.

DETAILED DESCRIPTION

The terms appearing below and inflected forms thereof are defined foruse in this disclosure and the appended claims as follows:

-   -   “acquire” or “capture” refer, in the context of a viewer's        gesture, to the process of obtaining digital images or video of        the gesture(s) from a sensing system, which typically (but not        necessarily) includes a vision sensor, such as a camera.    -   “associating,” when used in the context of a relationship        between a viewer interaction/gesture/communications device and a        viewer, means that the viewer interaction or gesture or        communications from the communication device are sourced from or        otherwise pertain to the viewer.    -   “content” means whatever is delivered to a viewer via the MVD.        Embodiments of the invention result in an update to content        based on a viewer's interaction with the system. In some        embodiments, at least some updated content is delivered to a        viewer's communications device (e.g., smart phone, tablet,        etc.).    -   “datum” means an item of information.    -   “multi-view display” or “MVD” means a display that is capable of        simultaneously presenting a different image to each one of        plural viewers that are at different viewing angles (locations)        with respect to the MVD. The different images seen by each of        such different viewers is displayed in the same location of the        display.        Additional definitions may appear throughout the disclosure in        context.

MVD system 100, which is depicted in FIGS. 1A-1D, includes MVD 102,system controller 104, and sensing system 106. MVD system 100 is capableof displaying a unique content stream to each viewer in detection region108. In the illustrative embodiment, each viewer is able to interactwith the MVD system by making gestures. The gestures convey a viewer'scommands/preferences with respect to content that they wish to view. Thegestures are captured by the system, associated with the gesticulatingviewer, and interpreted. The MVD system then responds by deliveringcontent to the viewer at the location at which they interact with thesystem. The various elements of MVD system 100 are now described.

Multi-View Display 102.

MVD 102 is capable of displaying different images to different viewersbased on a difference in viewing location. The principle of operation ofan MVD is known to those skilled in the art and so will be discussedonly briefly. The salient difference between a single view display and amulti-view display is that the former displays the same image to allviewers while the latter is able to display different images todifferent viewers simultaneously.

Some versions of a multi-view display include one or more projectionelements that emit light of different color and brightness at differentangles. The projection element includes a light source, an imager, and alens. Examples of suitable imagers include, without limitation, digitalmicro-mirror devices, liquid crystals, light emitting diodes, and/orliquid crystal on silicon (LCOS). Each projection element can beconsidered to be a single pixel of the display, wherein a full graphicmulti-view display is formed from an array of such projection elements.In some embodiments, each projection element—each pixel—is controlled byits own processor. In some other embodiments, a processor controlsplural projection elements, but less than all of the elements of thedisplay. In some embodiments, all of such processors in the display areconnected via a network (e.g., Ethernet, Infiniband, I²C, SPI, Wi-Fi,etc.), or, more generally, a communication channel (e.g., HDMI, etc.).

The light source illuminates the imager and the imager filters ordirects the light through the lens. The lens is capable of directinglight that is received from different locations of the imager indifferent directions. For example, a projector with resolution of1920×1080 is capable of controllably directing light in over two milliondirections. The color and brightness emitted at each angle is different.Each element, from a viewer's perspective, appears to be a light sourceof the color and brightness of the light that is projected onto theviewer, even if the projection is too dim for any image to be visible onnearby surfaces. As a consequence, the appearance of each projectionelement from the perspective of a viewer is dependent upon the angle atwhich the viewer views the element.

As will be appreciated by those skilled in the art, the foregoingprovides a description of one of a variety of different implementationsof a multi-view display. Any implementation of an MVD known to thoseskilled may suitably be used. Furthermore, embodiments of an MVD asdisclosed in U.S. patent application Ser. No. 15/002,014, entitled“Method for Calibrating a Multi-View Display,” may suitably be used inconjunction with embodiments of the present invention.

Sensing System 106.

In the illustrative embodiment, sensing system 106 provides two basicfunctions: presence detection/location determination and gesturerecognition.

With respect to presence detection or location determination (thosephrases are used synonymously herein), sensing system 106 is capable ofdetecting the presence/determine the location of each of a plurality ofviewers, represented in FIGS. 1A through 1D by viewers V1 and V2, indetection region 108. Regarding gesture recognition, sensing system 106is capable of capturing and interpreting viewer gestures.

In the illustrative embodiment, sensing system 106 is a machine/computervision system, the key elements of which include an imaging device(s)for image acquisition and software for accomplishing any of variousdigital image processing techniques for extracting the requisiteinformation. It will be appreciated that in addition to or as analternative to the imaging device, other devices/techniques can be usedfor locating a viewer (e.g., RF triangulation techniques, GPS, etc.).

The imaging device(s) typically include one or more cameras as well aslenses and lighting that are designed, collectively, to provide therequisite differentiation that is required by subsequent processing. Insome embodiments, the camera(s) is a depth-aware camera, such asstructured light or time-of-flight cameras, which can generate a depthmap of what is being seen through the camera at a short range, whereinthis data is then used to approximate a 3D representation of what isbeing seen. In some other embodiments, the cameras) is a stereo camera,wherein, using two cameras whose relations to one another are known, a3D representation can be approximated by the output of the cameras.Depth-aware and 3D cameras are particularly useful in conjunction withthe gesture recognition function of sensing system 106. In some furtherembodiments, one or more standard 2D cameras are used for imageacquisition. In some additional embodiments, the imaging devicecomprises a radar system. Those skilled in the art will know how to makeand/or specify and use various cameras, radar, or other imaging devicesfor the purposes of presence detection and gesture recognition.

Sensing system 106 can employ conventional (2D visible light) imaging,although other techniques, such as imaging various infrared bands, linescan imaging, 3D imaging of surfaces or other techniques may suitably beused. Those skilled in the art while know how to select and use anappropriate imaging technique in conjunction with embodiments of theinvention.

In some embodiments, the imaging device is combined with the imageprocessing unit. In the illustrative embodiment, the imaging device isseparate from the image processing unit, the latter of which isimplemented by software running on system controller 104.

After an image is acquired, it is processed by any of a number of imageprocessing techniques, including stitching/registration, morphologicalfiltering, thresholding, pixel counting, segmentation, edge detection,blob discovery and manipulation, to a name a few. Such techniques can beused for presence detection/location determination.

There are a variety of techniques, well known in the art, for gesturerecognition. Gestures can originate from any bodily motion or state, buttypically originate from the hand or face. Most techniques rely on keypointers represented in a 3D coordinate system. Based on the relativemotion of these pointers, a gesture can be detected with high accuracy,depending on the quality of the input and the particular algorithm thatis applied. Two main approaches for gesture recognition are:3D-model-based and appearance-based models. The former approach uses 3Dinformation of key elements of body parts in order to obtain severalimportant parameters, such as palm position or joint angles. The3D-model approach typically uses volumetric or skeletal models, or acombination thereof.

Appearance-based systems use images or videos for direct interpretation.Such models do not use a spatial representation of the body; rather,they derive the requisite parameters directly from the images or videosusing a template database. Some are based on the deformable 2D templatesof the body parts, particularly hands. Deformable templates are sets ofpoints on the outline of an object, used as interpolation nodes for theobject's outline approximation.

Whichever presence detection and gesture recognition algorithms areselected for use, they are implemented as software that, in theillustrative embodiment, is executed by system controller 104.

In some embodiments, sensing system 106 further comprises passivetrackable object 114 (FIG. 1A), such as a wrist band, an arm band, eyeglasses, or have some other suitable form factor (e.g., wearable,readily carried, etc.) for accompanying anyone wishing to interact withMVD system 100. Passive trackable object 114 functions as an extensionof the body; that is, it is intended, by virtue of its design, toemphasize a gesturing body part (e.g., hand, arm, head, etc.) by makingthat part more distinguishable from its surroundings that it wouldotherwise be. Doing so simplifies presence detection and/or gesturerecognition (e.g., by improving “resolution” of an acquired image,reducing processing requirements, etc.). In some embodiments, this isaccomplished by imbuing passive trackable object 114 with certainsurface characteristics (e.g., color, reflectivity, etc.) that render itreadily trackable and distinguishable from other surfaces in detectionregion 108.

In some further embodiments, sensing system 106 further comprises activetrackable object 116 (FIG. 1A), which, like passive trackable object114, can also be in the form of a wrist band, arm band, etc. Unlike thepassive trackable object, active trackable object 116 includes sensorsthat capture a viewer's gestures and a wireless transceiver fortransmitting data related to the gestures to other elements of sensingsystem 106 for further processing. Such sensors include, for example,MEMS accelerometers, MEMS gyroscopes, and the like. Any of a variety ofshort range wireless protocols (Bluetooth, WiFi, etc) may suitably beused for communication. In some embodiments, the object 116 includesonboard processing of the data acquired by the sensor. In suchembodiments, active trackable object 116 can transmit an interpretationof the gesture or perform some preliminary data processing toward thatend, which is then completed by software running on system controller104. In some other embodiments, active trackable object 116 transmitsraw (unprocessed) data from its sensor(s) to other elements of sensingsystem 106.

It is notable that both passive trackable object 114 and activetrackable object 114 can be used for detection/location purposes. Forsuch uses, these objects can be in the form of a badge or sticker, inaddition to a wrist band, arm band, etc.

System Controller 104.

System controller 104, which is depicted in greater detail in FIG. 7,includes processor 760, processor-accessible data storage 762, andtransceiver 764.

In the illustrative embodiments, controller 306 executes specializedapplication software to determine viewing location and viewingpreferences from viewer gestures. In some other embodiments, one or bothof those functions are performed by other processors/computers. In suchembodiments, controller 306 simply receives a command to cause the MVDto display a specific image to a specific viewing location. Theoperation of system controller 312 is discussed in further detail inU.S. patent application Ser. No. 15/002,014, entitled “Method forCalibrating a Multi-View Display,” previously referenced.

Processor 760 is a general-purpose processor that is capable, amongother tasks, of running an operating system, executing device drivers,and populating, updating, using, and managing data inprocessor-accessible data storage 762. Processor 760 is also capable ofexecuting specialized application software for performing tasks such asthose depicted in FIG. 2, either alone or in conjunction with otherelements of MVD system 100. In some alternative embodiments of thepresent invention, processor 760 is a special-purpose processor. It willbe clear to those skilled in the art how to make and use processor 760.

Processor-accessible data storage 762 is non-volatile, non-transitorymemory technology (e.g., ROM, EPROM, EEPROM, hard drive(s), flashdrive(s) or other solid state memory technology, CD-ROM, DVD, etc.) thatstore, among any other information, data, device drivers (e.g., forcontrolling MVD 102, etc.), and specialized application software, which,when executed, enable processor 760 and MVD 102 to perform the methodsdisclosed herein. It will be clear to those skilled in the art how tomake and use processor-accessible data storage 762.

Transceiver 764 enables, in some embodiments, one or two-waycommunications with viewer-provided communications devices or otherelements of the MVD system 100 via any appropriate medium, includingwireline and/or wireless, and via any appropriate protocol (e.g.,Bluetooth, Wi-Fi, cellular, optical, ultrasound, etc.). The term“transceiver” is meant to include any communications means and, asappropriate, various supporting equipment, such as communications ports,antennas, etc. It will be clear to those skilled in the art, afterreading this specification, how to make and use transceiver 764.

FIG. 2 depicts method 200 in accordance with the illustrative embodimentof the invention. It is notable that some of the operations/tasks ofmethod 200 that are depicted as being distinct (e.g., tasks 202 and 203)would not necessarily be so. They should thus be understood as “logical”tasks, shown as being distinct for pedagogical purposes. Furthermore,the sequence in which the tasks appear is permutable; for example, task205 (determining of personal viewing space) can be performed before task204, task 206 (generating updated content) can be performed before task205, etc. It will be apparent to those skilled in the art how thesequence of tasks can be altered. Additionally, method 200 will bediscussed in conjunction with FIGS. 1A through 1D, which depict twoviewers V1 and V2. It is to be understood that MVD system 100 is capableperforming method 200 for many more viewers (limited primarily by thesize and resolution of the display and the size of the viewing area)simultaneously.

In task 201 of method 200, the MVD system detects/locates viewers asthey enter detection region 108. Referring again to FIGS. 1A through 1D,sensing system 106 detects/locates viewers V1 and V2.

At task 202, query whether viewers are interacting (e.g., gesticulating,speaking, etc.) with MVD system 100. If so, the interactions arecaptured, per task 203. In the illustrative embodiment, the interactionsare gestures, which are captured via sensing system 106. For example, aviewer might wave their hand from right to left (to indicate, forexample, a desire to replay an earlier moment in a content stream thatthey are viewing). It is notable that MVD system 100 associates eachgesture with its source; that is, a particular viewer. This is typicallyaccomplished by assigning an identifier to each detected viewer andassociating the gesture with the identifier corresponding to the viewerfrom which the gesture is sourced. As discussed later in conjunctionwith FIG. 4, the viewer interaction can be the viewer speakingcommands/preferences. In such an embodiment, sensing system 106 includesmicrophones.

Per task 204, the captured interactions are interpreted. In theillustrative embodiment, this task requires gesture recognition, whichis performed via gesture recognition software that is running, forexample, on system controller 104. Once the interaction is interpretedby the software, MVD system 102 associates the interaction withparticular commands or viewer preferences pertaining to the content thatthey wish to view. In some embodiments, a look-up table provides therequisite association between a given gesture and the command/preferencethat it's intended to convey.

In accordance with task 205, a personal viewing space for each viewer(at least those that interacted with MVD system 100) is determined. Aviewer's personal viewing space is the region of space in which updatedcontent that is to be delivered to the viewer (i.e., based oninterpreted gestures) is viewable. A viewer's personal viewing space isa function of the viewer's location with respect to MVD 102 withindetection region 108. Since in the illustrative embodiment the viewer isnot stationary, neither is the personal viewing space; it moves with theviewer.

Ideally, the personal viewing space is small enough so that the onlyviewer that will see the content displayed by MVD 102 is the viewer forwhom the content is intended. Typically, the only viewing perspectivefrom which content needs to be viewable to a viewer is from that of theviewer's eyes. However, in the illustrative embodiment, the personalviewing space covers a viewer's complete body; this reducescomputational overhead related to image processing. See, for example,FIG. 1A, depicting personal viewing space 110 _(L1) of viewer V1 andpersonal viewing space 112 _(L2) of viewer V2. As indicated above, thepersonal viewing space moves with the viewer. In FIG. 1C, viewer V1 haspersonal viewing space 110 _(L3) after moving from location L1 (FIG. 1A)to location L3. And viewer V2 has personal viewing space 11214 aftermoving from location L2 (FIG. 1A) to location L4.

In task 206, updated content is generated based on the interpretedviewer interaction. In the illustrative embodiment, this is performed bysystem controller 104.

In task 207 of method 200, the system causes updated content to bedisplayed to the viewer. Such content is viewable at the viewer'spersonal viewing space. For example, in FIG. 1B, viewer V1 sees, frompersonal viewing space 110 _(L1), content C1 projected by MVD 102.Viewer V2 sees, from personal viewing space 112 _(L2), content C2projected by MVD 102. Depending on the status of viewers V1 and V2, thecontent being viewed might be preliminary information pertaining to theuse of the system (e.g., how to gesture to provide commands to thesystem, etc.) or, if they have been interacting with the system, contentC1 is updated content based on viewer V1's interaction with MVD system100 and content C2 is updated content based on viewer V2's interactionwith MVD system 100. In the illustrative embodiment, system controller104 directs the operation of MVD 102 to display the appropriate content.

It is notable that content C1 and C2 can be displayed in the same regionof MVD 102 (they are shown at different regions in the Figures forclarity of illustration) for viewing by respective viewers V1 and V2that have different viewing angles with respect to MVD 102.

Returning to method 200, processing loops back at 208 and querieswhether any (further) interactions are detected. If so, tasks 203through 207 are repeated such that updated content is presented to theviewer. For example, in FIG. 1C, wherein time has elapsed relative toFIG. 1A, viewers V1 and V2 have moved from respective locations L1 andL2 to respective locations 13 and L4 and are assumed to have interactedwith the system. Based on that interaction, new content is generated(task 206) and is displayed by MVD 102. As depicted in FIG. 1D, updatedcontent C3 is displayed via MVD 102 for viewing at personal viewingspace 11013 of viewer V3. Likewise, updated content C4 is displayed viaMVD 102 for viewing at personal viewing space 112 _(L4) of viewer V2.

In the illustrative embodiment, content is not displayed to a viewerwhile they are moving. For example, in FIG. 1C, viewer V1 has moved tolocation L3 and viewer V2 has moved to location L4. Once viewer V1 movedfrom location 11 and viewer V2 moved from location L2, the systemstopped delivering content to them. However, at their new locations L3and 14, the viewers interact with MVD system 100 and, in accordance withmethod 200, the system then delivers updated content C3 to viewer V1 andupdated content C4 to viewer V2. In some other embodiments, content isdisplayed to a viewer continuously.

Returning to task 202, if an interaction is not detected, query at task209 whether the viewer has left the detection region. If so, then themethod terminates for that viewer. If the viewer is still present,processing loops back at 210 to task 202.

FIGS. 3A and 3B depict MVD system 100 used in conjunction with a productsample display. Product sample displays are commonly used to sellpersonal electronics and other goods since they permit the consumer toclosely examine the products before purchase. Such displays presentchallenges for retailers; there is usually very limited space forsignage to advertise the features of each product. This problem isaddressed via embodiments of the present invention, wherein a single MVDsimultaneously displays targeted content to each of plural shoppers.

FIG. 3A depicts shopper S1 examining product 320 and shopper S2examining product 322 on product display 318. MVD 102 displays Content320 for viewing at personal viewing space 110 _(P1) of shopper S1 anddisplays Content 322 for viewing at personal viewing space 112 _(P2) ofshopper S2. The system performs method 200, previously discussed, toprovide content updates to the shoppers. In this scenario, the“interaction” indicative of a command/preference pertaining to contentis the shopper moving close to a particular product on display 318. Thatis, the movement towards the product, or the viewer's presence near aproduct, is a “gesture” that can be interpreted by the system. Inparticular, since shopper S1 is standing in front of product 320, MVDsystem 100 displays content related to product 320 to shopper S1.Likewise, since shopper S2 is standing in front of product 322, MVDsystem 100 displays content related to product 322 to shopper S2.

Of course, other gestures could be used to convey product interest. Forexample, reaching a hand toward a particular product, rather thanstanding in front of it, is an interaction that could trigger contentpertaining to that product. Alternatively, standing in front a productcould result in the display of a first level of product information to ashopper, while reaching for or handling the product could result in acontent update, wherein additional product information is provided. Withrespect to handling a product, the use of additional sensors, such as aswitch that detects when a product is lifted for examination, orinertial sensors on a product that can detect movement and/ororientation, can be used to generate appropriate content for display.When such additional product sensors are used, signals from the sensorsmust be associated with a particular user. In some embodiments, this isdone by correlating the location of the shoppers, as determined viasensing system 106 or other location determining system, with theactivated sensor (which is pre-associated with the particular product).

The history of a viewer's interactions with MVD system 100 can be usedin conjunction with content updates. For example, consider FIG. 3B,wherein shopper S2 moves from a location in front of product 322 (FIG.3A) to a location in front of product 324. In response to this movement,and based on the fact that shopper S2 was formerly in front of product322, MVD 102 now displays, to personal viewing space 112 _(P3) ofshopper S2, updated content pertaining to both products 322 and 324.

FIG. 4 depicts an embodiment of MVD system 100 wherein the sensingsystem further comprises a plurality of microphones 428. In such anembodiment, a viewer/shopper can simply speak commands/preferences tointeract with MVD system 100. That is, the “interaction” is the viewerspeaking to the system. For example, viewer V1 can say “back” to causecontent stream C5 to repeat content that was already displayed. Or aviewer, such as viewer V2, can say “forward” to cause content stream C6to jump ahead. In such an embodiment, rather than using image processingin conjunction with the interaction (i.e., to decode a gesture), aspeech processor is used (i.e., to decode the verbal commands).

It will be appreciated by those skilled in the art that to associate averbal command with a viewer: (1) microphones 428 must determine thesource (location in space) of a verbal command and (2) the location asdetermined by microphones 428 must be registered/calibrated with alocation (e.g., of the viewer, etc.) determined by image processing (sothat the system knows how a location determined by the microphonesrelates to MVD 102). As long as the acoustically determined location andthe optically determined location are “calibrated” with one another, thesystem can determine which viewer (i.e., viewer V1 or V2 in FIG. 4) isthe source of a particular command. Techniques for performing suchregistration/calibration are well known in the art.

FIG. 5 depicts an embodiment of MVD system 100 wherein installedcommunications system 540 enables viewers to provide certain identifyinginformation to the MVD system. Viewer V1 enters identifying informationinto user interface 542 appearing in a display of installedcommunications system 540; viewer V2 has already entered suchinformation. For example, viewer V1 can input information thatidentifies herself as a member of certain rewards programs, an exclusiveshopping club, as having certain interests (e.g., sports, electronicequipment, books, etc.), and the like.

It will be appreciated that MVD system 100 must be able to detect and“identify” each viewer that inputs information, so that such informationis associated with the appropriate viewer. In this context, the term“identify” does not mean that the system must know the precise identity(i.e., the name) of the viewer. Rather, “identify” means that to theextent sensing system 106 detects a “blob” (such as via a blob detectiontechnique) in detection region 108, the system must be able torepeatedly associate that particular blob with the information that wasinput by the particular viewer. That is, the system must be able toidentify, on an ongoing basis, any given blob as the blob associatedwith certain information (as input by a particular viewer).

In the embodiment depicted in FIG. 5, the installed communicationssystem is located within detection region 108, such that sensing system106 can detect and identify viewer V1 in the manner of previouslydiscussed embodiments. In some other embodiments, camera 544 ininstalled communications system 540 can perform thedetection/identification functions in conjunction with appropriatesoftware. The information received by installed communications system540 is transmitted, either wirelessly or via wireline, to systemcontroller 104 for use in content generation.

Once a viewer, such as viewer V2, has input identifying or preferenceinformation into installed communications system 540, content, such ascontent C7, can be provided to the viewer as they move through detectionregion 108. The presentation of content can be triggered, for example,by a viewer's location (e.g., as being near a particular retailestablishment, etc.) or by their interactions with the system, in themanner previously discussed.

Although FIG. 5 depicts a single MVD 102 and sensing system 106, in someembodiments, MVD system 100 includes multiple MVDs and multiple sensors(providing a distributed sensing system or multiple sensing systems),thereby establishing plural detection regions and displays for contentdistribution located throughout an environment, such as a shopping mall,etc.

FIG. 6 depicts an embodiment of MVD system 100 wherein at least someinteraction between a viewer and the system is implemented via aviewer-provided communications device, such as smart phone 650-1, tablet650-2, computerized eyewear, etc. Such devices include a variety ofinput and output devices by which a viewer can interact with MVD system100 to affect the type of content presented.

For example and without limitation, a touch screen display of thecommunications device can be manipulated to select among variouscontent-related options, an inertial measurement unit or camera can beused to facilitate gestural input by moving the communications device,the microphone of the communications device can be utilized for voiceinput. Other non-limiting examples of interactions with viewer-providedcommunications device include:

-   -   content navigation, wherein the viewer can use the        communications device to navigate through the content seen by        that viewer;    -   content download, wherein the viewer can download content        related to what is displayed via MVD 102, such as downloading a        coupon for a displayed item for sale, downloading a map showing        the location of an item displayed via MVD 102, etc.;    -   identification, wherein the viewer can indicate membership in a        particular group and select content on that basis. For example,        a viewer might identify herself as a fan of a particular        designer, and the system will cause MVD 102 to display content        based on that interest; and    -   tagging, wherein a viewer collects pointers to content for later        review or for sharing on social media, or wherein a viewer        leaves comments on social media that can then be viewed by        others when viewing the particular MVD 102 or related displays.        In some embodiments, access to such comments is moderated by        existing social networks—for example, sharing comments with        friends only, etc.

The location of the communications device must be registered/correlatedwith the viewer so that the MVD system knows that information itreceives from the communications device (based on the viewer'sinteraction therewith) pertains to the particular viewer. As such,sensing system 106 includes devices/techniques for locating people aswell as their communications devices. Devices/methods for locatingindividuals have been previously discussed. Device/methods for locatinga communications device include, without limitation, cross-motionanalysis (i.e., correlate data from inertial sensors in thecommunications device with motion of the viewer, as obtained via thesensing system); GPS; Bluetooth tag or i-beacon for ranging; WiFitriangulation; acoustic triangulation using microphones; presenting, viaMVD 102, a display code to a viewer, wherein the display code is theninput into the communications device and transmitted back to the MVDsystem 100 (this technique is disclosed in further detail in U.S. patentapplication Ser. No. 15/002,164 entitled “Individually InteractiveMulti-View Display System and Methods Therefor”.

It is to be understood that the disclosure teaches just one example ofthe illustrative embodiment and that many variations of the inventioncan easily be devised by those skilled in the art after reading thisdisclosure and that the scope of the present invention is to bedetermined by the following claims.

1. A method for operating a system including a multi-view display,wherein the multi-view display is visible in a viewing area comprising aplurality of viewing zones, the method comprising: detecting a presenceand determining a location of a plurality of viewers, including a firstviewer and a second viewer, in the viewing area of the multi-viewdisplay, wherein a location of each viewer in the viewing region at anymoment defines, for each viewer, a personal viewing zone; detecting afirst interaction of the first viewer with the system and a secondinteraction of a second viewer with the system, wherein detecting thefirst interaction and second interaction comprises capturing, via amachine/computer vision system, gestures performed by respective firstand second viewers, and further wherein the gestures: (i) originate froma bodily motion or state of each of the first and second viewers, (ii)represent at least one of a command and a preference of each of thefirst and second viewers pertaining to content, which can be differentfor each of the first and second viewers; generating first content basedon the first interaction and second content based on the secondinteraction; displaying, via the multi-view display, the first contentto the first viewer and the second content to the second viewer, whereinthe first content is viewable only in the first viewer's personalviewing zone and the second content is viewable only in the secondviewer's personal viewing zone.
 2. The method of claim 1 whereingenerating first content based on the first interaction furthercomprises: interpreting a first gesture performed by the first viewervia a gesture-recognition model used in conjunction with themachine/computer vision system to determine the command or preference ofthe first viewer pertaining to content.
 3. The method of claim 2 whereinthe gesture-recognition model is a 3D-based model.
 4. The method ofclaim 2 wherein the gesture-recognition model is an appearance-basedmodel.
 5. The method of claim 1 and further wherein a first gesture ofthe first viewer comprises the first viewer's presence in a sequence oflocations.
 6. The method of claim 5 wherein interpretation of the firstgesture is based on an order in which locations in the sequence arevisited by the first viewer.
 7. The method of claim 5 whereininterpretation of the first gesture is based on specific locations inthe sequence.
 8. The method of claim 1 wherein the machine/computervision system comprises a passive trackable object and the gesturecomprises moving the passive trackable object.
 9. The method of claim 1wherein the location of each viewer is determined via themachine/computer vision system.
 10. The method of claim 9 wherein themachine/computer vision system comprises an imaging device and a passivetrackable object.
 11. The method of claim 9 wherein the machine/computervision system comprises an active trackable object.
 12. The method ofclaim 1 further comprising updating the location of the first viewer andthe second viewer.
 13. The method of claim 1 further comprising ceasingto display the first content to the first viewer when the first vieweris moving.
 14. The method of claim 1 and further wherein the firstcontent is associated with a first viewing zone, the method furthercomprising continuing, for at least one of a limited period of time or alimited distance, to display the first content to the first viewer whenthe first viewer moves away from the first viewing zone.
 15. The methodof claim 1 wherein the first content is associated with a first viewingzone and the second content is associated with a second viewing zone,the method further comprising: displaying, on the multi-view display,the first content for viewing by the first viewer when the first vieweris at the first viewing zone; and displaying, on the multi-view display,second content for viewing by the second viewer when the second vieweris at the second viewing zone.
 16. The method of claim 15 wherein whenthe first viewer moves from the first viewing zone to the second viewingzone, the method further comprises displaying, on the multi-viewdisplay, third content for viewing by the first viewer, wherein thethird content pertains to the first content and the second content. 17.The method of claim 15 wherein the first content pertains to a firstproduct.
 18. The method of claim 17 wherein the first product issituated proximal to the first viewing zone.
 19. The method of claim 16wherein the first content pertains to a first product and the secondcontent pertains to a second product.
 20. The method of claim 19 whereinthe third content is a comparison of the first product and the secondproduct to one another.
 21. A multi-view display system comprising: amulti-view display, wherein the multi-view display is visible in aviewing area comprising a plurality of viewing zones characterized by aviewing-zone coordinate system, and wherein the multi-view display emitsa plurality of beamlets characterized by a beamlet coordinate system; acalibration system, wherein the calibration system generates arelationship between the viewing-zone coordinate system and the beamletcoordinate system, wherein the relationship determines which beamlets ofthe plurality thereof are emitted from the multi-view display to presentcontent to a specified viewing zone in the viewing area; a sensingsystem that: a) detects a presence of viewers in the viewing area, andb) optically captures interactions of the viewers with the system,wherein the interactions are gestures of the viewers; and one or moreprocessors that collectively: a) associate the interactions withindividual ones of the viewers, and b) update, in conjunction with thesensing system, a location of at least some of the viewers, as theviewers move through the viewing area; and c) command the multi-viewdisplay to display content related to the interactions to the associatedviewer, wherein the displayed content is viewable only by the associatedviewer.
 22. The system of claim 21 wherein the location of said someviewers is updated only when viewers interact with the system.